A Survey on Touchless Heart Rate Measurement Using Facial Expression for Covid Patient

Abstract

This research describes both a touch-free heartbeat detection system and a cardiopulmonary signal modeling technique. A vector network analyzer is used to test a microwave system for detection of a heartbeat signal at a distance of 1 m from a person. The developed system can detect heartbeat signals and adjust their frequency and strength. Measurements are taken at 2.4, 5.8, 10, 16, and 60 GHz, as well as at power levels ranging from 0 to -27 dBm. Based on data for both breathing and heartbeats, a model of the recorded signals reflecting cardiopulmonary activity is provided. The heartbeat rate and variability are obtained from the modeling signal using wavelet and classic filters. 0and-20dB

Introduction

I. INTRODUCTION

This research describes both a touch-free heartbeat detection system and a cardiopulmonary signal modeling technique. A vector network analyzer is used to test a microwave system for detection of a heartbeat signal at a distance of 1 m from a person. The developed system can detect heartbeat signals and adjust their frequency and strength. Measurements are taken at 2.4, 5.8, 10, 16, and 60 GHz, as well as at power levels ranging from 0 to -27 dBm. Based on data for both breathing and heartbeats, a model of the recorded signals reflecting cardiopulmonary activity is provided. The heartbeat rate and variability are obtained from the modeling signal using wavelet and classic filters. 0and-20dB.

Heartbeat detection is one of key techniques to monitor our health condition in daily life, and demands for this technique have increased year and year. Heartbeat signals are generally monitored as the most important vital activity signs of life. Creating a real time, multi parameter measurement platform based on this technology will be the subject of future work. You would be able to use this technology on a phone, laptop or device with a camera. In existing System, we use Four Component Analysis Methods and Accuracy Also Change As per method. And Its Time-consuming Process. And our system We Try to give better accuracy and Using One Machine Algorithm and Try To save time. we proposed a Doppler sensor-based heartbeat detection method by heartbeat signal reconstruction with convolutional CNN and Haarcascade. Specifically, we construct a deep learning model with convolutional CNN and Haarcascade to reconstruct a heartbeat signal. As an input to convolutional CNN and Haarcascade, to reconstruct a heartbeat signal based on the periodicity of heartbeat and the spectrum distribution peculiar to heartbeat, successive spectrograms within the frequency range that might be related with heartbeats used. Furthermore, for better heartbeat signal reconstruction, the RRI estimated just before is also used as a feature.

A. Objective

Based on this technology, future development will focus on developing a real-time, multi-parameter measuring platform. This technique can be applied to a phone, laptop, or any other device with a camera. Based on this technology, future development will focus on establishing a real-time, multiparameter measuring platform. This technology can be implemented to a phone, laptop, or any other device with a camera.

B. Motivation

In an emergency, your pulse rate can help determine when their heart rate increases sufficient to extract enough blood. Assist in the identification of symptoms such as an irregular or fast heartbeat, confusion, fainting, chest discomfort, or breathlessness.

C. Interface

Hands free heartbeat is a user interface app that allows a touch less pulse as its foundation. There are two kinds of hardware interfaces:

RAM: 8GB. Because we've been referred a ML method and an availability of Special Level Components, for a laptop, the minimum amount of RAM required is 8 GB. Because the CTS can image data set is 40 GB in size, a hard disk with a minimum capacity of 40 GB is required.

Intel i5 processor (Intel Core i5)

Spyder is the required IDE. Best Comprehensive Application Framework because it provides suggestions while inserting code snippets, making typing convenient and quick. The coding language is Python 3.5. A very specialized programming language for system method is now available owing to the accessibility of High-Performance Libraries.

Windows 10 is by far the most complete operating system which allows for any form of installation or development. Software Interactions in the Third Dimension the system software is Windows 10.Spyder is an application framework. Python is a programming language.

D. Module

1. Admin: The admin must use a valid account and password to activate this module. After successfully signing in, one can perform a variety of things, including All Users can be viewed and authorized. All E-Commerce Websites Can Be Seen and Authorized Explore Most Goods and Reviews, View All Product Early Reviews, View All Keyword Search Details, View All Keyword Search Results, View All Product Review Rank Results, View All Product Review Rank Results. Monitor and Authorize Users The supervisor receives access to the following over all registered users in this module. The administrator may inspect the customer's data, such as login-name and security code, email, and address. The administrator grants permission to users. Examine the Charts' Outcomes Show all product search ratios, all keyword search results, and all product review rank results.

2. Ecommerce User: There are n users for this module. The user still must register before engaging in any activities. When an user authenticates, the information they provide is recorded in the database. He must log in using his approved login-name and security code after properly registering. After logging up, any consumer can do things like Add Products, Check Every Ingredients with Reviews, View All Early Product Reviews, and View All Purchased Transactions.

3. End User: This module has a total of n users. The user first should register before engaging in any activities. Whenever an user authenticates, their data is saved in the database. He must login using his approved username and password after properly registering. The user will play a range of actions after successfully signing in action.

II. LITERATURE SURVEY

This paper [1], presents a system for touch-less heartbeat detection and a cardiopulmonary signal modeling approach. Using a vector network analyzer, a microwave system is tested for the detection of the heartbeat signal at a distance of 1 m from a person. The proposed system shows the ability of detecting the heartbeat signals with the possibility of tuning both frequency and power. Measurements are performed at 2.4, 5.8, 10, 16, and 60 GHz, as well as at different power levels between 0 and -27 dBm. Based on measurements performed for both respiration and heart beatings, a model of the measured signals representing the cardiopulmonary activity is presented. The heartbeat rate and the heart rate variability are extracted from the modeling signal using wavelet and classic filters, for SNR between 0 and -20 dB.

 In this paper [2],  Daily vital signs monitoring is very important for detecting diseases in early stages and for preventive treatments. Such a task can be achieved by taking advantage of the omnipresence of cameras in people's personal space. As heart-related diseases are part of the leading causes of deaths worldwide, monitoring heart-related vital signs appear to be very crucial. In this article we aim to provide a touchless approach and propose a robust method for estimating heart rate through analysis of face videos. In particular, we consider a challenging scenario, i.e., the user is on a video call and may often move his/her head. Existing touchless, vision-based methods use either photoplethysmography (PPG) or ballistocardiography (BCG). PPG methods exploit color changes in human skin during heartbeats caused by blood volume variations, but this is very sensitive to unstable lighting conditions. On the other hand, BCG methods exploit subtle head motions caused by Newtonian reaction to blood influx into the head at each heartbeat, thus being sensitive to a subject's voluntary head movements. Unlike conventional studies where either a PPG

method or a BCG method is used, we propose to combine both to overcome the weakness faced by each method. We use BCG methods as the main approach due to their better accuracy on heart rate estimation, and PPG methods are used as the secondary backup to improve the accuracy in cases of large and frequent voluntary head movements. To this end, we introduce a dynamic voting system that effectively combines results of several variants of PPG and BCG methods. Experiments conducted on 20 healthy subjects with different skin tones in different lighting conditions show that our method has better accuracy compared to state-of-the-art methods, well addressing large voluntary head movements. Our method had a mean absolute error of 1.23 beats per minute (BPM) in the cases without voluntary head movements and 2.78 BPM in the cases with voluntary head movements.

In paper [3], author previously proposed heartbeat measurement by airflow at the mouth, and applied the catheter flow sensor to evaluate the airflow [1-3]. This time, we applied the drug to a rat to change the heartbeat frequency and tried to detect its change by catheter flow sensor. MEMS technology was used to fabricate the catheter flow sensor with an outer diameter of 1.8 mm to be applied to the measurement in the rat. The catheter flow sensor output was calibrated by a commercially available mass-flow controller. The catheter flow sensor was inserted into the airway of the rat to detect the airflow, and the four rod-shaped electrodes were used to obtain the ECG signals. The airflow waveforms were analyzed by discrete Fourier transform to obtain frequency spectra. Both results, the frequency spectra from the airflow and the ECG signals, were coincident, and the heartbeat signals decreased to 5.37 Hz from 7.08 Hz due to the inderal injection.

In [4] paper, Heartbeat detection is one of key techniques to monitor our health condition in daily life, and demands for this technique have increased year and year. Thanks to the non-contact and non-invasive features, various Doppler sensor-based detection methods have been investigated so far. However, the heartbeat detection accuracy of the conventional methods could get degraded due to the low SNR (Signal-to-Noise Ratio) of heartbeat components. Thus, even after some signal processing, non-heartbeat components still remain over such processed signal, which could degrade the heartbeat detection accuracy. In particular for the subjects with low HR (Heart Rate), the estimated HR tends to be higher than the ground truth HR due to such non-heartbeat components, though the conventional methods have mainly focused on the heartbeat detection against the subjects with the normal HR higher than 50 bpm (Beats Per Minute). In this paper, to accurately detect heartbeat even with low HR via a Doppler sensor, we propose a heartbeat detection method based on heartbeat signal reconstruction with convolutional LSTM (Bidirectional-Long Short-Term Memory). In the proposed method, to reconstruct a heartbeat signal based on the periodicity of heartbeat and the spectrum distribution peculiar to heartbeat, successive spectrograms that might be due to heartbeat is used as an input to convolutional LSTM. In addition, for better reconstruction of a heartbeat signal, the previously estimated RRI (R-R Interval) is also used as a feature in the proposed deep learning model with convolutional LSTM. Through the experiments, we confirmed that our proposed method accurately detected heartbeat against 17 subjects including the ones with the HR lower than 50 bpm.

In this work [5], author proposed a measurement system that extracts heartbeat interval data from multiple piezoelectric sensors placed on a chair that eliminates noise generated by body movement. We asked five healthy males (21-24 years old) to sit in an arbitrary position on a chair that had eight piezoelectric sensors attached, and heartbeat signals were measured. The experiment consisted of four measurements (5 min measurements after adequate rest), while performing specific body movements at a specific time, with deliberately mixed noise of body movements. To remove body movement noise, bandpass filter processing (4 Hz-20 Hz) was applied to the signal obtained from the piezoelectric sensors, and the heartbeat component was extracted using independent component analysis (number of separations was eight) on the processed waveform. For verification, the error rate was obtained before and after the removal of body movement noise, respectively. The error rate after removal of body motion was 2.91 ± 0.75%. In our previous study with two piezoelectric sensors without body movement, the error rate was 2.47 ± 2.66%. Therefore, our proposed measurement system may improve the accuracy of heartbeat interval detection, which can be observed continuously by removing the body motion

In [6] paper , author propose a system which simultaneously measures 3-D shape of chest and minute change of chest shape by heartbeat by a hybrid stereo method combining the passive stereo and the active stereo. Specifically, the 3-D shape of the chest is measured by the passive stereo using two infrared cameras. By projecting the dot matrix pattern on the chest surface using a laser projector, it is possible to capture minute shape change due to heart beat based on the principle of the active stereo. The proposed system is expected to be useful as a visualization tool for easy mechanical phenomena of the heart.

In this work [7], The detection of breathing and heartbeat from a distance is important for medical triage and mass casualty events as well as routine monitoring of higher-risk patients. Typical approaches include wiring up patients to devices and wearable devices, but remote detection and monitoring is both easier on the patient and easier to administer. Monitoring at low frequencies means that there is less patient risk as well as extended range and reduced power. In this paper we look at the measurement of breathing and heartbeat of human subjects at UHF frequencies. We characterize the system design and capabilities as well as the algorithmic approach to extracting the signal. We measure biometric ground truth using heartbeat sensors, respiration monitors, and accelerometers. We do accurately measure breathing, and can measure heartbeat when the subject is holding his breath, but have not yet separated the heartbeat from breathing when both are being done simultaneously.

This paper [8], author propose a system which simultaneously measures 3-D shape of chest and minute change of chest shape by heartbeat by a hybrid stereo method combining the passive stereo and the active stereo. Specifically, the 3-D shape of the chest is measured by the passive stereo using two infrared cameras. By projecting the dot matrix pattern on the chest surface using a laser projector, it is possible to capture minute shape change due to heart beat based on the principle of the active stereo. The proposed system is expected to be useful as a visualization tool for easy mechanical phenomena of the heart.

In paper [9], Accurate access to respiration rate (RR) and heartbeat rate (HR) through radar is of great importance in many applications. In this paper, a novel method based on convolutional sparse coding (CSC) is proposed for respiration and heartbeat rates measurement. To solve the problem of algorithm performance degradation caused by insufficient samples, a number of samples are generated by mixing random noise with original signal. Then radar signals are processed by CSC directly in the time domain. The method is tested by a vital sign data generated by finite differences timeaaram kr re babu domain (FDTD) simulation. The results demonstrate that the proposed processing approach can accurately extract the respiration and heartbeat components with the generated data of 5 seconds.

In this work [10], previously proposed heartbeat measurement by airflow at the mouth, and applied the catheter flow sensor to evaluate the airflow [1-3]. This time, we applied the drug to a rat to change the heartbeat frequency and tried to detect its change by catheter flow sensor. MEMS technology was used to fabricate the catheter flow sensor with an outer diameter of 1.8 mm to be applied to the measurement in the rat. The catheter flow sensor output was calibrated by a commercially available mass-flow controller. The catheter flow sensor was inserted into the airway of the rat to detect the airflow, and the four rod-shaped electrodes were used to obtain the ECG signals. The airflow waveforms were analyzed by discrete Fourier transform to obtain frequency spectra. Both results, the frequency spectra from the airflow and the ECG signals, were coincident, and the heartbeat signals decreased to 5.37 Hz from 7.08 Hz due to the inderal injection.

Conclusion

In this paper, a Doppler sensor-based heartbeat identification technique on heartbeat signal reconstruction with convolutional CNN and Haar cascade that successfully identified heartbeats even with low HR (Heart Rate), e.g., less than 50bpm (Beats per Minute) (Long Short-Term Memory). We create a DL model to imitate a cardiac signal using convolutional CNN and Haar cascade. Sequential spectrogram switching in the frequency range associated with heartbeat is utilized like an interface to convolutional CNN and Haar cascade to reconstruct a heartbeat signal based on heartbeat periodicity and spectrum distribution. In furthermore, the RRI collected previously will be used as a feature for enhanced heartbeat signal reconstruction. The results of previous research showed that even when the detection range was increased, for example, to 2.0 m, our proposed method produced a low AAE (Average Absolute Error) of 3.84 bpm versus 17 patients, 5 of whom had an HR less than 50 bpm. visiting this location This is where you\'ll find the conclusion stuff. This is where you\'ll find the conclusion stuff. This is where you\'ll find the conclusion stuff. The conclusion is contained throughout this article.

References

[1] E. B. Rimm, M. B. Katan, A. Ascherio, M. J. Stampfer, and W. C. Willett, “Relation between intake of flavonoids and risk for coronary heart disease in male health professionals,” Ann. Internal Med., vol. 125, pp. 384–389, May 1996. [2] J. T. Brindle, H. Antti, E. Holmes, G. Tranter, J. K. Nicholson, H. W. Bethell, and D. J. Grainger, “Rapid and noninvasive diagnosis of the presence and severityofcoronaryheartdiseaseusing1H-NMRbasedmetabonomics,”Nature Med., vol. 8, pp. 1439–1445, Dec. 2002. [3] A. Hernando, J. Lazaro, E. Gil, A. Arza, J. M. Garzon, R. Lopez-Ant´on, C. de la Camara, “Inclusion of respiratory frequency information in heart rate variability analysis for stress assessment,” IEEE J. Biomed. Health Inform., vol. 20, no. 4, pp. 1016–1025, Jul. 2016. [4] J. Allen, “Photoplethysmography and its application in clinical physiological measurement,” Physiol. Meas., vol. 28, no. 3, pp. R1–R39, Feb. 2007. [5] C. Gu, C. Li, J. Lin, J. Long, J. Huangfu, and L. Ran, “Instrument-based noncontact Doppler radar vital sign detection” IEEE Trans. Instrum. Meas., vol. 59, no. 6, pp. 1580–1588, Jun. 2010. [6] G. Vinci, S. Lindner, F. Barbon, S. Mann, M. Hofmann, “Sixport radar sensor for remote respiration rate and heartbeat vital-sign monitoring,” IEEE Trans. Microw. Theory Techn., vol. 61, no. 5, pp. 2093–2100, May 2013. [7] J. Tu and J. Lin, “Respiration harmonics cancellation for accurate heart rate College Short Form Name, Department of Computer Engineering 2021 39 measurement in non-contact vital sign detection,” in IEEE MTT-S Int. Microw. Symp. Dig., Jun. 2013, pp. 1–3. [8] J. Tu and J. Lin, “Fast acquisition of heart rate in noncontact vital sign radar measurement using timewindow-variation technique,” IEEE Trans. Instrum. Meas., vol. 65, no. 1, pp. 112–122, Jan. 2016. [9] M. Sekine and K. Maeno, “Non-contact heart rate detection using periodic variation in Doppler frequency,” in Proc. IEEE Sensors Appl. Symp., Feb. 2011, pp. 318–322. [10] A.Tariq and H. G. Shiraz, “Vital signs detection using Doppler radar and continuous wavelet transform,” in Proc. 5th Eur. Conf. Antennas Propag., Apr. 2015, pp. 285–288. [11] M. Akay, “Time frequency and wavelets in biomedical signal processing,” IEEE Press, New York, 1998. [16] S. [12] Mallat, and W.L. Hwang, “Singularity detection and processing with wavelets,” IEEE Trans., IT, vol. 38, pp. 617- 643, 1992. [13] Lazaro A, Girbau D, Villarino R. Analysis of vital signs monitoring using an IR-UW [14] Linda J. Vorvick, “Vital signs”, MedlinePlus, January 21, 2013. [15] Joseph J. Carr, John M. Brown, “Introduction to Biomedical Equipment Technology Second Edition”, Prentice Hall, 1993, pp.123–124.

Copyright

Copyright © 2022 Samidha Dhamale, Rutuja Sarvade, Gitanjali Gore, Shweta Ambegave, Prof. Manisha Desai . This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.